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* ^CETA''S RESULTS AND THEIB IMPLICATI 

The Comprehensive Employment and Training Act^(CETA) faces expiration 
September 30, 1982! In anticipation Of the required reconsideration, it is 
timely to begin a review of the CETA experience since 1974, as well as the 
relevant -experience of 'employment and training programs that preceded CETA. 
The critical ^issues are (1) what have been CETA's results?, (2) what have 
been its problems?, and (3) what are the^ impl icatit)ns*for continuation and 
modification? 

CETA is both a package of alternative employment and training services 
and a system for the delivery of those services.-' Both must be examined in 
pursuit of answers to the three queries. 



^ The Results 

.The ultimate goal of CETA's .empToyment a/id training services is to 
improve the employment and earnings of an, economically disadvantaged 
clientele (Table 1). For most of those , services, results c*n be measured 
by the earnings and employment gains of participants compared to thg^e of 
similar nonprogram participants. Some services have other objectives or 
results not directly and measurably related to employment and earnings. 
For those, other measures of results must be derived, " , 

Evaluative" data are limited but consi'stent in their findings. From 
the sources described in the methological appendix, the evidence (Table II) 
indicates that almost all of the major CETA components were a good invest- 
ment for society. 

0 Every dollar investednn on-the-job (OJT) trai*ning returned $2.28 
in social benefits. . 

0 A dollar spent on' Job Corps' returned at^out $1.39 to society. 

0 

r 0 Every dollar spent on classroom training* returned $1.14 to 

society* 

0 Participants In public service employment in 1976 earned roughly 
$290 more than the comparison group individuals in 1977 and 1978. 

0 Enrol lees in work experience unadorned by other training ac- 
tivities had, on .the average, no higher or lower» post-participation gains 
than their comparison groups. 

' ^ Cost-benefit analysis and other statistical evaluation methods are, of 
course,* not an exact science. But the direction of these findings is 
consistent with a wide range of assumptions. The present value of returns 
to the taxpayers, tended to be less than costs primarily becau^^e stipends 
^rid wages constituted a neutral transfer payment to society but were a 
budgetary cost; . to th.e taxpayer. This fact may help ej^plain why. taxpayers 
appear restiye about '^hat appears to be a productive social investment. 
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Table I 



\ 

CETA' Component Enrollments and Costs / 
(1980) 



, * Cost per Cost per 

Component Enrollment service year participant 



On-the-job training . 


'^181,000 


$ 6,08^ ^ 


$2,080 


Job Corps 


' 95,000 


13,193 


5,827 


Classroom training 


» 

. ' 750,000 ► 


8,046 


3., 554 


Public 'service employment 


870,000 


^9,030 


3,702 


Work experience' 


400,000 


5,311 


1,641 


Summer youth employment 


705,000 


N.A. 


N.A. 


Other youth programs 


^ 330,000 


N.A. 


N.A. 



Source: ,U.S.- Department of Labor, Employment and Training Administration 



1 



ERIC 



r 



Table II 
CETA Component Qutcomes 



Earnings increase 
over comparisort groups Benefit-cost 
(197 6 e nroHees) ratio 



Component 

• » " • 


1977 


'1978 


percent 
change 
in. 1977- 
over 
comparison 
gro;jps ' 


• 

social 


taxpayer 


On-the-job training • 


' $839 


$574 ■ 


' 18 ' 


2.28 


.72 


Job Corps 


209*^ 


487*^ 


8 ^ 


1.39 


\91 ^ 


Classrpom training ^ 


?47 


442 


10 


1.14 


.60 


Public service employment 


261 


326 


7 


. ' NA^ 




✓ 

Work experience 


-147 


-187 


-4 


.50 


.50 



' . ^ ft. 



^For the data sources, assumptions used, and a discussion of the iiiethology. 
^ see appendix. 

^Jdb Corps data for 1978-,79 follow-up of 1977 enrol lees. 

^Not calculable biecSuse of uncertainties of value of work accomplished. 



The CETA components for which earnings increases are not directly 
measurable and benefit-cost ratios are not calculable fit into three 
categories: (1) nonoccupational training, (2) youth school retention and 
wofk transition progprams, and (3) pilot projects not large enough to be 
generaiizable. But even for these, indicators of success or failur§ can be 
derived.* 

0 The Summer Youth Employment Program reduced arrest rates from 3.2 
percent to 1.5 percent and failure to return to school from 9.4 to sil 
percent, \ 

0 The Youth Incentive Entitlement Program, which provided guar- 
anteed employment in return for a pledge to return to, or stay in, school, 
raised retention rates from 76 percent to 80 percent and increased the rate 
of return to. school by dropouts from 22 percent to 36 percent. 

0 The SupDcTrted Work program improved the employment and earnings 
experience of AFDC recipients and[^^x-Gf fenders but not youth and addicts. 

0 Participation in 12 week adult basic -education programs in 
specific instances raised reading and math skills ^one to 1.5 years, and 
attainment of general education development (GEO) .certificates improved 
placement chances by 8 percent and earnings by 13 percent. 

0 English as a second language was effective at opening the labor 
market to refugees and other immigrants at low cost. 

, 0 Job search training programs cit. costs ranging from $200 to $1,000 
per participant improved job finding success by 25 to 50 percent. 

^ 0 The Career I;itern program which raised /high school completion 
rates by 50 percent and employment probabilities by one-third may be 
representative of alternative school programs funded ^y CETA« 

Strengths and Weaknesses ^ 

CETA's problems must^^be divided between those that relate to its 
service components and tho^'e that e^nerge from the delivery system. 

'Service Components » 

s The major focus of CETA system has been on the build up, management, 
and precipitous dismantling of a major public service employment program. 
As a result, in most cases, there has been little attention given to 
innovation ip training models. ^ Even though the results remain positive, 
one would have hoped for significant improvements under local stewardship. 
Yet some of the old problems remain, and new ones have emerged. 

1. ' CETA has not generated new training institutions. Instead, it 
has utilized skill centers established in the 1960s and some mainstream 
vocational ^ and proprietary schools. While the latter may offer quality 
training, they often lack" the experience, rapport, and supportive services 
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to dedl with a disadvantaged populatioji. The ^ETA eligible population must 
be screened for them/ Specialized skill centers were created under the 
Manpower DevKjlopinent and Training Aiiiini stration in the 1960s to serve that 
population, and many still exist. Their staffs are dedicated, but their 
facilities and equipment often have Seen allowed to deteriorate. There is 
increased use of community-based organizations as training organizations. 
They tend to do well in remedial education and English as a second lan•^ 
guage, but, with some notable exceptions, lack the experience and facili- 
ties for quality occupati oj^al training. 

2. Just as in the period before CETA, there are far mor£ eligible 
mdivTduals than there are funds to serve them,. The federaf pressure is to 

' keep per participant costs low and to insure immediate placement. These 
objectives are accomplished by stressing short-tenn ti^ining averaging less 
than half a year for high turnover occupations for which a disadvantaged 
'person can be prepared at'the entry level in a short time. But longer 
training pays off although, not necessarily in immediate placement rates. 
Long term follow-up data desnonstrate a positive rel^onship between 
training duration and future earnings. For instajice, tn«se trained for 
between 11 and 20 weeks -earned *an average' of^$269 more per year than 
comparison' groups in the two years following participation; those with 20 
to 40 weeks of training earned $724 more; and those few trained beyond 40 
weeks gained $1,487 per year. 

3. Some people ^eem to enroll in CETA programs in order to receive 
the training allowance. In fiscal 1980, 30 percent of the funds expended 
for CETA's Title'^IIBC training programs were used-for allowances. Even 14 
and 15 year olds receive the nininum wage for their hoursief participation. 
As a result, some participants receive higher take-home pay dirmg training 
than before and after placement. While few would begrudge this in-program 

* income, there is'*concern for the distorted incentive affeets and for 
applicants who are not admitted to training "because funds are inadequate. 
Training programs should place less emphasis on income support and more on 
actual training. Tii,e evidence indicates that few people would be unable to 
enter these programs if a reasonable shift in funds was made* in the 
direction of a higher percentage going to actual training and less to 
allov/ances. ' * ' * 

4. On-the-job training remains the highest payoff component, yet 
. less than 10 percent of< CETA participants are enrolled in it. Employers 

are reluctant to participate for a subsidy of 50 percent of wages for an 
average of 4.1 months of training. If they can be persuaded to partici- 
pate, they tend to insist on very restrictive screening. 

5. * Job Corps is a honed and refined system which has learned and 
profited from past criticism. It is centrally funded by an experienced 
staf-f but decentrally operated by private and public contractors. It has a 
common curriculum a'nd staf»f development program and a feedback sys,tem that 
allows each center to learn from the experience of all others. It also has 
had the funding to invest in computer-assisted and 'computer-maaaged in- 
struction and other .tV^aining innovations. It deals with the most dis- 

. advantaged of youth, but its residential .setting makes Jt possible to 
confconjtr^their personal ^s well as occupational needs. Mobijity, which 
exposes youth to other labor markets, also >s important. The Job Corps* 
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,most serious weaknesses are its^ inabil ity to retain more than one-third of 
the enrol lees. and the lack of platf^ment assistance. 

, 6. .Work experience, in nKjSt .settings*, provides income and involve- 
ment in rudimentary work .activities but seem^ to do nothing to. increase 
employabil i ty. However, a few prime sponsors have imaginatively liaked 
work experience with classroom and on-the-job tra.ining with impressive 
r)6sults. *Also work experience for in-school youth is a proven approach to 
increase school retention and reduce crime', even if there are no positive 
employment and income results. 

7. Public service eniployment,> as practiced prior to the 1978 CETA 
amendments, seems to have served in part as on-fhe-jjob training in the 
public sector. ,PSE parti ci[3ants who went on .to regular jobs in public 
agenci,es accounted for most of the estimated earnings gains. Hov/ever, the 
1^78 amendments focused PSE on a more ^iisadvantaged population and fostered 
a worK crew approach which is more like work experience -than like OJT. No 
infQ,nnation is currently available to determine whether or not earlier 
tncome gains >i^e persTstHd -^Yorrq mtU tfxB-vt^r bennfrtrs^ pr^yduced try ttri^ 
targeted ap^proach.^ 

8. Remedial basic education and English as a second language (ESL) 
are essential to those who lack them, but they meet the full needs of only 
those who are ^otherwise employable. Therefore, except in areas with a 
large, number of immigrants with substantial previous work experience, 
iremedial education and ESL are more appropriately perceived as supportive 
components to occupational skill training. 

9.,^ Job search training, on the other hancl, appears to be useful in 
the short run to job'seekei^s at every level of the labor market. What is 
lacking is knowledge of whether these investments pay off over the long 
run. How muc^ 'of these job seeking skills are retained by CETA clients 
over the couVse of time? 

10. TKere are a variety of alternative schools and school -to-work 
transition services which appear promising but need further refinement and 
experience before wholesale adoption. ^ 

11. For all CETA components, th©' more highly disadvantaged, in 
general, make the greatest gains. The^e gains tend to be achieved, not 
from higher 'wages than those of comparison groups, bu^from increased labor 
force participation ^and more stable employment. These programs probably 
provide a new access route into the labor market, but little training is 
provided, for more than entry Tevel jobs. Given the economic and^ demo- 
graphic realities of the 1960s and 1970s, there may have been some justi- 
fication for this. But in*the 1980s, access beyond the entry level will be 
increasingly required to help both CETA clients and employers who wi Hi face 
a different set of demographic and economic forces. 

The Delivery System 

Experience seems to 'support the general decentralized and decate-. 
gorized approach that underlies the CETA delivery system. * However, a 
number of weaknesses deserve attention. 




1. Few of the federal staff at the national and xwional |evel have 
had experience at the front line of a prime sponsor ope^tion. The two 
seta of staff do not have the common experience and l-anguage to allow them 
to communicate and understand each other's problems. Since the federal 
staff are not generally^ capable of providi;ig technical assistance ta >in- ^ 
prove the output of CETA services, they t'end to einpha,size er>forcement of\ 
procedures to the exclusion of substantive concerns. ' There should be 
greatet* . exchange of personnel at the various levels to build that body of 
common experience and rapport. ' ' ' " 

2. A major positive development of CETA training is .the increased ' 
use of inainstream trainin| facilities. \ This reduces the segregation of 
CETA-eligible clients by not isolating them in s[5eciaVly designed insti- „ 
tutiens. ^ • 

3. / CETA promotes, in theory, labor market.^pl anning * Yet the exist- 
ing incentives aif^e inadequate to encourage units of governroent to combine 

in meaningful labor inarket-wide^consortid. Tha-bduUflce- ftf.-54»tQ& also h a^ — 
no labor market meaning. Planning is to be forward looking and continuous. 
Yet the data prc^vided for planning pui^poses,^ especially kno\^ledge of future 
' funding levels, is aWays late and sometimes long after^ the fact. Prime 
sponsors are hindered by constant! changes in regulations, program struc- 
tures and funding levels. The planniiig concept will not bQ [neanVngful 
Njntil there is mujti-year funding and stability. In federal polici^es. 

4. The inputs of all relevant interests in tf\e communi ty-- target 
groups, ^employers, labor '.'organizations and service del iverers--are 
essetvtial to decentralized'/ decisionmaking. However, Congress has now 
mandated three sets of advisory councils for each prime sponsor, all with 
overlapping and unclear functions. 'One should be enough. 

5. Efforts have been made to increase private sector rem^ial 



employment and- training programs. However, the results have ba^ very 
mixed, and CETA ^private industry councils have not demonstrated a better 
track record compared to prime sponsors in the marketing of OJT. Yet 
pri\^ate sector efforts should be continued arrd encouraged. 

\ 6. The people in the middle in the CETA system have come to be the 
regional office staff. At present, they have few meaningful functions and 
'little authority. As such, they are often, at no- fault of their own, 
impediments in the communicatiOQS. process. They should have, a meaningful 
role and authority to carry it out or be removed froci the scene. 

7.'' ^ There has been a continuous but unsuccessful search for designing 

performance measurements. The immediate placement and positive ternination 

rate standards are misleading and counterproductive. They favor short 

duration training and vjiork experience because they produce low-cost 

immediate payoffs, although lortger term follow-up data prove tnat long 

duration training- and on-the-job training have much higher ratios of 

benefits over costs. 

* 

Reporting systems require data which are of little value to the 
fe'deral agency and provide no useful feedback to the states and localities. 
Yet Job Corps demonstrates the potential for using modern data processing 
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equipment for a uniform system in which toth -indiv idudl participant data 
and I martageinent information can be entered to be recalled at all levels for 
meaningful analysis. It merits examination to determine the feasibility of 
replication on a broader scale. * . • ^ ' * ? , ^ 

8. .No useful system of technical assistance and staff development 
has emerged. At this point, the expertise is in the skills of the most 
alert of tffB pr ime ^sponsor • staff around the country. Initial experii^ients, 
are underway with prime-to-prime technical assistance*, and this should be 
encouraged. To have 6 substantial impact, such technical assistance andf 
staf^ development aid^must be made' available in the local.^'communi ties . 



Increasing the Payoff 

Two de(?ade s ago, the^nation ma ^ e_ a comm i tment to u pg rade and give a 

^second chancy to those ruembers droits work force who were experiencing 
labor marke^ hardship.. In many cases labor market pathol ogi es ^resul ted 
Decause the nation's primary "first, chance" institutions were failing 
certain types of individual s . 0 A /'se^nd ;:hance'\ system was required to 
deal with remedial employment ^and training "jx^b^l ems. 

In recent years ^edf^ coverage ot CETA has .centerjtd on fraud and 
abusft. .Any undertaking Involving bill^on^ of do'llars iilid millions of 
individuals ts likely to be iiiarred by graft and corruption. Strong efforts 
must, be made to rout out any corruption, but CETA has not experienced a 
uniquely higher l^el compared to other Inul tibil lion dollar un'dertaJ^ngs . 
In -the meantime, it is clear that, despite limitations and administrative, , 
problems, most of CETA's service jomponents have been moderately successful 
with benefits well in excess qf costs. A number of options are available 
to increase that payoff. ' * • * 

• , . T 

1. Emphasis should turn froin employment to training within CETA's 
range of .service alternatives with opportunities in both t^assroom and 
on-the-job training. The need for job creation programs should, however, 
not be ^glected. In soTie labor markets, the. existence of substantial 
surplus labor may .Tiea^Vpthat job creation the most realistis^ use of 
public funds and ot^t'^he participants' time. 

2. Given the div'ersity of the CETA-el igible populationy a .two-tiered 
classroom training system a[>pears desirable. Remedial and entry level 
training for all would be /available, while a second level of career 
training should ^e provided for those who are able to profit from more 
advanced 'training. The Temedial/entry training could occur in a spe- 
cialized institution such as a skill center that prov^'des all the necessary 
supportive services. The career training should occur in the mainstream 
institutions in those communities in which they enjoy a positive* image in 
the minds of employers, the student body and the public. Training should 
also involve the workplace whenever possible. 



3. The tj^aining al lowance system shoul d be adjusted tp provide a 
subsistence component (based on family income and need) and an incentive 
component (tp encourage perfonnance, completion and placement). But income 
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support should be used sparingly to maxitmze resources allocated for actual 
'training. ^ , " . ^ 

4. OJT rules should be liberalized to jmprove access to the private 
sector. A short, "try-out" period ^perhaps 3 months) before hiring, with a 

jmniraum transition requirement, ancfLwit?ii subsequent on-the-job trairmig 
subsidies where deinonstrably ne^dedzilprobably would increase the effe?- 

. tiveness and^^warketatrTTTty of OJT. However, ,'^s indicated by the initial 
efforts 'of even the private industry council s^ OJT^ can be exp^ted to 
pr6vide sljots for on*1y a fraction of individuals in'the.CETA pool, parx 
ticul^arly when jobs in the pirivate sector are expanding slowly. 
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5. The Job^torps has bec(!hie successful and effective for the qne- 
third of the participants who cofiiplg4;e thQ program. , It is a model Qf 
comprehensive tre^itment, providing a complete spectrum of opportunities 
^'^n^ing from special learning aid for the disabled all the way to co,llege 
options for cgrpsmenibers. Computer-assisted and computer-managed ^- 
stcuction is, if\dividualized and 'seTf-pacelT wtttr cTChlevements -^recorded an^ 
rewarded. However, it is mainly residential and "the 24-hour-a-day" 
treattnent effect cannot be overlooked. The approach of competitive 
contracting with the private sector mi^ht be extended to more parts of the 
CETA system. Also, the utilization of programmed learning, devices and 
curriculum materials, which have proved <o be succes'sfi^l, should t)e 
expanded beyond* the Job Corps. ^ ^ 

'.6. A variant of PSE sho'uld be introduced ' which would permit a 
ir^y-out for unsubsidized jobs in the public and noxiprofit sectors, parallel 
to OJT in the private sector. Th»fe_6hould be the same possibilities for 
OJT sut7>»dization after the try-out but also w>th the same transition^il 
requirements. - ^ 

7. Work exVr-ience- should be coupled with remedial education and 
occupational training as part Of a sequefw;e of services for youth and 
"particularly disadvantaged adult subgroups. 

8». Job search assistance appears* to be an effective ntectiani sm, at 
least in the short, rnin, ' for helping, individuals whp are" al ready seeking 
work— rather) than as a tool to motivate persons to find employment. If.it 
were utilized as a final comppnent of other program activities, it^ would 
probably, increase placement r-dtes. Cjjrrent budgetary obstacles to its 
provision through the pub^iC|employment service also should be el im.i|»ated. 

9. Remedial basic education and English as a second language are*low 
cost, productive programs and essential for those who lack them. 

10. Emphasis should be placed on sequential )ie6hin5 of different 
services so that ^n individual can be helped on* several fronts. Basic 
education, for example, could be interfaced wit>i 'occupational skill 
training, which would lead to OJT or job search instruction. While this 
wi>l raise costs, it is a worthwhile investment. 



11. A more extensive interchange of federal, state, and local per- 
sonnel should become a regular part of the CETA program to create, a common 
experience base for communication and understanding. Training expertise 
should be incorporated into both prijne sponsor and federal staff. 
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12. Ap effective national system of technical assistance and* cur- 
riculum and staff -development . should be^ introduced , drawing-^ on prime 
.sponsor strengths, as well as on private and .publ ic education sources.-. 
National workshops ^ce -hfelpful but such ^ssTstance mus^t be brought to the 
local level on a periodic .basis as weTI . 

* • ' , * / 

^ 13. i Congress should provide mul ^i-year /unding, to CETA prfne sponsors 
'^and restrain itself from tao frequent innovations in the system. . * ' 

V ' the Future . » 

In many ways, demographic and economic developments are recreating the 
issues of which MDTA e.nerged; in,1962i,. When the federal^ goVerniiient 

initially fundeid employnent and training programs, a wptr on poverty was not 
yet declared and the disadvantaged had not been discovered. Technological 
d.isp1acement and Appalachian" planj: closings, at first were the major 
mbtivators for the le^iUatipn that was, directecf toward" "retraining." All 
of, today's robots and computers were on^ th^ 'horizon * at a'lower level of 
sophistication and at higlrer relative costs. But the, entry of the baby 
Doom generation, and millions of wOmen (including wiveb'and mothers) into 
the labor force depressed the relative wage structure compared to the cost 
•of capital goods and' encouraged more labor intensive^ production processes.- 
Slow growth and excess capacity also reduced the drive toward major capital 
investments. ' . ^ ' 

Now international competition and economic problems in certain regions 
of the U.S. renew the plant closing and relocation threat. All the si^ns 
are for continued influx of refugees and other immigrants. Geographical 
barriers will become inore, not less, < serious for central city residents, 
even as their numbers decline. The shrinking numbers of new youth entrants 
to the labor force will require more, not less, training. Delayed retire- 
ment may involve second careers and retf^aining rather than continuation of 
the old jobs. The displaced hpmemaker has not disappeared fran the scene? 
Job creation in both* the public and pnivate sectors will remain .necessary 
in central cities and depressed areas. Periodically rising national' unem- 
ployment will refocus 'attention from, time to time on the public service 
employment issue. ■ - 

As recent events in the armed forces 'have demons tratedr^ in tens-ive 
capital investments in highly advance'd equipment require efforts, to build 
and maintain a wel T motivated and skilled work force. Deficiencies i<vthe • 
latter types of investments can vastly reduce the benefits of the former. 
More emphasis will have to be placed on skilV upgrading if the workforce is 
expected to utilize proauctively the teehnologic.al advances of anticipated 
higher capital investitient rates. 

Given this setting and the proven results'of CETA in the training 
field, it is 'time to strengthen--though not necessarily enlarge--the only 
available "second chance*' training system we have in America. In a period^ ^ 
when 'we must be concerned about reducing inflation, boosting American 
productivity, and strict federal budget constraints, it is important to 
realize t^jat investing in human capital' stil 1* makes good econonic sense. 
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Appendix * • * . ^ 

He'iJ^odological Considerations ^* 

The inetfJodolQgy djployed 1n the social benefif-cost analyses contained 
i/i this policy statement considers the costs to society to include all 
program operating expenses except transfers, plus foregone earnings of the 
participants. Benefits include the e^tifnated value of useful work.per- 
fonped during enrollment, post-program earnings gains (from ^higher v/ages 
and/or increased hours of paid employment), administrative cost savings 
from reduced participation in income mainteaance programs, and various 
oth^r social benefits (e.g., in the case *of Job Corps these benefits in- 
cluded savings. from r.educed crime, and drug and health problems). 

Future net benefitb are discounted at a rate of 15 percent per year to 
estimate a present value of this stream of gains at the ,time the program 
expenditures were made. The discount .includes a real rate of interest ^nd, 
an inflation factor.* Al-so, ttre benefit-cost ratios assume a 14 percent 
annual decline, in, the .neasured gains between the program participants and 
canparison groups. ^ * . , . , ^ ^ 

The taxpayers' benefit-cost ratio considers all^ budgeted items, 
including trainee al lowances, 'as costs. The entire earnings gains, and 
foregone earnings a/e not included in this ratio because only taxes on 
earnings gains are "benefits to the taxpayers. *Thi^ ratio also consid&rs 
the benefits of output produced in the programs and the various estimated 
savings from' reduced cricie and transfer payinepts as well as changes in 
, adjninistrative costs, between social programs. 

Various assumption^ are made regarding the average future worklife for 
program participants. For the Job Corps th^ avei^ge is assumed to be 4'3 
years,* while l^or classroom training the average is assumed to be 39 year^. 
But givei^ the 14 percent annual decline in assumed measued gains, and the 
15 .percent discount rate, esti^nates are not vastly, altered if worklife 
assumptions are somewhat different/ 

• Esti/nates of Job Corps impacts are based on a two-year follow-up of a 
sam;^le of 1977 participants and a carefully selected comparison group drawn 
from eligible youth from areas of limited Job Corps r^ecruiti'ng and further 
matched by regression analysis. For other 'CETA components the continuous 
longitudinal manpower survey (CLMS) data followed for two years a sample of 
participants who terminated in 1975, The comparison group was drawn from 
the Current Population Survey, with matched data o)3tained from Social 
Security records. The CLMS earnings and employment data for participants 
w^s then matched to the comparison group data for net impact estimates. 

The procedures for selecting the comparison groups and for measuring 
post-program earnings are rtgorous and generally conservative so as not to 
exaggerate impacts.. For example, all estimated incViKle an assumed annual 
decline in the differentials between pai*'ticipants and comparison groups, 
even though the measured differentials for some CETA 'component^ (i.e.,, 
classroom .training and Public Service Employment) grew larger between the 
first and second year. More years of- follow-up will be required before we' 




"Now if the participants* ^benefit tiine paths move further apart, converge, 
ojr remain parallel over time withyCOfppacison-^groups. 

There are other technical issues inherent in the . ex-post- facto 
niultip.ld regression inatching of participants with nonpai:tici pants and thre 
uso -of Social Security data to estimate comparison group earnings. Also, 
longitudiiidl data take many years *to collect and months to analyze*. It H 
reasonable to expect that, the gap between the time period >c6vered and 
release date of the data will be shortened,^ but the gap — due to the very 
nature of longitudinal data^-will remain significant. Most of the apparent 
changes since tlie 1976 CETA cohorts' studied could have been expected to 
have widened the post-enrol linent^ yap between the treatment and comparison 
groups. For insti[|jcei woi.ien as a proportion of all enrol lees has risen, 
and wo«nen l"wcj higher wage 'gains than fDen in. the years studied. Also, as 
noted, in the text, longer training duration brings higher gains, and* 
training durations have lengthened. On the other hand', it 1$ noted in the 
text that PSE gains maj^\have fallen. ^ 

Yet having made alj^of ^hese qgal ificatlons .regarding the data source, 
the' estimation assumptions, \he creation of comparison groups, and thd time 
lag, th# National Council on Emplpyment Policy believes that the results 
are important andl^ should not, be ignored. Des^pite these problems, this 
methodology and data have" real advairitages over previous attempts, and 
tentative conclusions an# lessons canN)e drawn from this body of infor- 
mation. Also*, '"the general findings for the various component's * and in- 
dividuals served by theje programs remain robust under a wide r^nge af 
assumptions. , . * 

Further^ det§ils and analysis of this methodology are provided'^by 
CharTes Majler", et al . , The Lasting Impacts of Job Cprgs Participation 
(Washington, H-C: USGPO, May 198Q].; Mathematics Policy Research. Evalua- 
tion of the Ecooonic Impact of the Job Corps Program ^ Second Follow Up 
Report (Washipcfton, D.C.: USGPO, April 1980); Robert Taggart, A Fisher- 
nan's Guide— An Assessnent of Training Programs for Persons df Limited Em- 
pi oyabil i ty , 1981, unpublished; Net Impact Report Number 1--I;npact on 1977 
Earpimjs of New "1976 CE TA Enrol lees in Selected Program Activities 
(Washington, D.C.; USDQL, June 1981); Westat, Inc.. Supplement Number 1 to 
Net Impact ReporJ: ^iumber 1- - Impact of 1978 Earnings on^ New FY 1976 CETA 
Enrol lees in Selected, PrQar"am Activities (unpublished, February 1981); The 
Board of Directors, Manpower DeinonstP^i on Research Corporation, Summary 
and Find i ngs of the National Supported Work Demonstration ' (Cambridge, 
Mass.: Ballingexi. Publishing Co., 19?0)i and Richard P. Nathan, Publ ic 
Service En)ployfnept: A Fipld Evaluation (Washington, JD.C: The Brookings 
, Institution, 1981). 7^ 

Given the real world probjems of statistttal research, the fate of any 
one program should not rise' or fall based on only one experiment. However, 
the most recent CLMS data on the change in earnings after program partici- 
pation 'seem to follow the general findings of previous research of em- 
ployment and training programs, as indicated by the following, survey 
(Table III): ' ^ ' - ^ ' 
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The Change \n EaVnings for the Year After Program Participation 



Table III 



CLASSROOM TRAINIHG 

Ashenfel ter 
B^ack N'ales 

Block Fenaies 
Unite Fenaies . 

Sorus 

Borus and Prescott 

ferjles 

Cooley.^Guire and 
Prescott 

Males 
Ferales 

hjrdin and BoruS 



Minonty Females 
>«n}te Females 

Kjefer 

Black Males 
Whue Males 
Slack Females 
Uhue Femahs 

Ma^n « 

Page; GoodYn9 

Prescott and Cooley 
.Males 

Sewell 
' Males 

Cain and Stronsdorfftf 

White Hales 
White Fern^les » 

ON-THE-JOB TRAINING 

Cooley, HcGuire and 
Prescott^ 

Fenaies^ 



Minority Males 
White Kales 
Minority Females 
White Females 



$318 t6 $470 
139 to 322 
441 to 552 
354 to 572 



305 



516 
38 



71 to 234 
168 to 291 



251 



1B4 . 

701 



(-742) to (-355) 
(-644) to (-375) 

591 . 

639 

409 
446 



* 652 



432 



B2B 

336 ' 



(-3B) to 59 
30 to 226 



1.984 
2.1B1 
8^ 
926 



ON-THE-JOB TRAINING 

Kiefer 

Black Males . 
White Males 
Black Females 
White Females 

Prescott and Cooley 
Males 

Sewell 

Males 
Fena 1 es 



$(-160) 
(-•61) 
386 
926 



796 



JOB CORPS 
Kiefer 



Black Males ' 
White Males 
Black Females 
WhUe Females 

Hallar 
Males 

Females without 

Chidren 
Females with 

Children 

YOUTH WORK-EXPERIENCE ' 
PRbGRAMS 

Borus, Brennan, and Rosen 

Males 
Females 



375 ' 
354 



(-1791 
(- 74) 
(-188) 
(-780) 



187 
565 



'06) 



554 
74 



Kiefer 

Black Males 101 

White Males (-1.298) 

Black Females • ( -40) 

White Females (-419) 
• ' 't 

Somers and Stromsdorfer 

Black Kales 1.245 

White Males r ^ 795 

Black Females 1.031 

White Females 187 

ADULT BASIC EDUCATION 

Brazzie 

Hales 2.368 

Roomkin ^ ^ 

Males ^ ^ 31B 

Females " 12 

ADULT WORK EXPERIENCE 



Minority Females » 367 
White Females 629 



SOURCE. Michael Borus, "Assessing the 
ed., E'noloyinq the Unemployed 
Citations, pp. iyb-i9/. T 
/ 
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f Training Programs." In E>i Ginzberg, 
Basic Books, 1980), pp. 34-35. 
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